Fast Committee Machines for Regression and ClassiGcation
نویسنده
چکیده
In many data mining applications we are given a set of training examples and asked to construct a regression machine or a classifier that has low prediction error or low error rate on new examples. An important issue is speed especially when there are large amounts of data. We show how both classification accuracy and prediction error can be reduced by using boosting techniques to implement committee machines. In our implementation of committees using either classification trees or regression trees, we show how we can trade off speed against either error rate or prediction error.
منابع مشابه
Fast Committee Machines for Regression and Classification
In many data mining applications we are given a set of training examples and asked to construct a regression machine or a classifier that has low prediction error or low error rate on new examples, respectively. An important issue is speed especially when there are large amounts of data. We show how both classification and prediction error can be reduced by using boosting techniques to implemen...
متن کاملImproving Regressors using Boosting Techniques
In the regression context, boosting and bagging are techniques to build a committee of regressors that may be superior to a single regressor. We use regression trees as fundamental building blocks in bagging committee machines and boosting committee machines. Performance is analyzed on three non-linear functions and the Boston housing database. In all cases, boosting is at least equivalent, and...
متن کاملPrediction of Seismic Wave Intensity Generated by Bench Blasting Using Intelligence Committee Machines
In large open pit mines prediction of Peak Particle Velocity (PPV) provides useful information for safe blasting. At Sungun Copper Mine (SCM), some unstable rock slopes facing to valuable industrial facilities are both expose to high intensity daily blasting vibrations, threatening their safty. So, controlling PPV by developing accurate predictors is essential. Hence, this study proposes improv...
متن کاملSTAGE-DISCHARGE MODELING USING SUPPORT VECTOR MACHINES
Establishment of rating curves are often required by the hydrologists for flow estimates in the streams, rivers etc. Measurement of discharge in a river is a time-consuming, expensive, and difficult process and the conventional approach of regression analysis of stage-discharge relation does not provide encouraging results especially during the floods. P
متن کاملCommittee Machines
In this chapter, we describe some of the most important architectures and algorithms for committee machines. We discuss three reasons for using committee machines. The first reason is that a committee can achieve a test set performance unobtainable by a single committee member. As typical representative approaches, we describe simple averaging, bagging and boosting. Secondly with committee mach...
متن کامل